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Abstract 



In a seminal article, Kahn has introduced the notion of process network and given a semantics for 
£SJ , those using Scott domains whose elements are (possibly infinite) sequences of values. This model 

^q' has since then become a standard tool for studying distributed asynchronous computations. From 

the beginning, process networks have been drawn as particular graphs, but this syntax is never 
formalized. We take the opportunity to clarify it by giving a precise definition of these graphs, 
that we call nets. The resulting category is shown to be a fixpoint category, i.e. a cartesian 
category which is traced wrt the monoidal structure given by the product, and interestingly this 
structure characterizes the category: we show that it is the free fixpoint category containing a 
given set of morphisms, thus providing a complete axiomatics that models of process networks 
p I , should satisfy. We then use these tools to build a model of networks in which data vary over a 

' continuous time, in order to elaborate on the idea that process networks should also be able to 

encompass computational models such as hybrid systems or electric circuits. We relate this model 
to Kahn's semantics by introducing a third model of networks based on non-standard analysis, 
whose elements form an internal complete partial order for which many properties of standard 
, domains can be reformulated. The use of hyperreals in this model allows it to formally consider 

the notion of infinitesimal, and thus to make a bridge between discrete and continuous time: 
time is "discrete", but the duration between two instants is infinitesimal. Finally, we give some 
examples of uses of the model by describing some networks implementing common constructions 



in 

m analysis. 

o- 

Process networks have been introduced by Kahn, together with an associated seman- 
tics based on Scott domains, as one of the first model for concurrent and asynchronous 
computations [TH]- These networks are constituted of processes (which may be thought as 
computers on a network or threads on a computer for instance) which perform computations 
and can exchange information through channels acting as unbounded FIFO queues. Finite 
or infinite sequences of values, that are called streams, are communicated on the channels, 
and the semantics of the whole process network is considered to be the streams that can 
be exchanged, depending on the data provided by the environment. The set of streams 
can be structured as a complete partial order, and the semantics of networks is modeled by 
Scott-continuous functions on this domain: the fact that these functions admit a smallest 
fixpoint turns out to be crucial in order to model "loops" formed by channels in the net- 
work. A series of subsequent works have provided a precise understanding of this fixpoint 
construction [TTllTo] . 
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In this model, time is discrete in the sense that a countable number of values might 
be exchanged during an execution: we can consider that each value occurs at a given in- 
stant t £ N. In this article, we are interested in understanding how to extend the usual 
semantics of process networks in order to consider computations in continuous time, by 
replacing N by R + for the domain of time, so as to embrace computational models such 
as electric circuits or hybrid systems, with which it bears many similarities. However, how 
would such a semantics relate to the usual discrete semantics of networks? The fundamental 
intuition in order to relate the two models is the following: if we allow ourselves to con- 
sider infinitesimal durations dt, then we can think of continuous time as being somehow 
"discrete", its instants being 0, dt, 2 dt, 3 dt, . . . This idea of infinitesimal time originates in 
the works of Bliudze and Krob [7], and was later on developed by Benveniste, Caillaud 
and Pouzet [5] , who formalized it by using tools provided by non-standard analysis [271 112j 
in order to give a rigorous meaning to infinitesimals. Here, we develop on these ideas by 
structuring the resulting notion of stream into internal Scott domains, which are shown to 
provide a model of process networks, and explain how the resulting model provides a nice 
bridge between discrete and continuous time. 

For this purpose, we introduce a new model for Kahn process networks. However, what 
is precisely the syntax for these networks that we want to model? Here, we formalize the 
definition of the graphs which are often used to informally represent process networks, by a 
structure that we call nets. We show here that the resulting category is a fixpoint category, 
i.e. a cartesian category which is traced [TS] wrt the monoidal structure provided by products. 
Moreover, this structure characterizes the category in the sense that the category of nets 
is a free category of such kind. This result thus provides a complete description of the 
axioms that a model of nets should satisfy. We finally use this structure to show that 
streams in infinitesimal time form such a model. We elaborate here on a series of earlier 
works. The structure of traced monoidal category for the Kahn model has been introduced 
by Hildebrandt, Panangaden and Winskel [T§] and the construction of nets introduced here 
is a generalization of the one introduced in [T5] . Properties of fixpoint categories and their 
relationship to fixpoint operators have been studied in details by Hasegawa [13] . 

We begin by defining nets (Section II. ip . show that they are free fixpoint categories 
fSection II. 2[) and explain that Scott-domain semantics can be given for nets f Section 1 1 .3(1 . 
We then recall basic constructions and properties of non-standard analysis fSection 12. 
define the notion of internal domain of which infinitesimal-time streams are an instance 
fSection 12. 2|) and relate models in infinitesimal and continuous time fSection 12. 3p . We 
finally conclude in Section [3] 



1 Nets and their semantics 

A Kahn process network [TT5] can be thought as a finite set of boxes, with 
inputs and outputs, linked through wires, producing outputs depending 
on their inputs which will be asynchronously transmitted over the wires. 
Over time, data circulates through the network, producing streams of 
data. The dataflow semantics of these networks has been well-studied in relation with 
Scott domains and category theory [251 I16j . However, there is no canonical syntax for 
them, even though a graphical notation (as pictured on the right) is often used. Since 
the purpose of this paper is to provide a new semantics for process networks, we take this 
opportunity to clarify the definition of the syntax, by formalizing the graphical notation and 
relating it with the categorical structure of the models. The ideas developed here in order 
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to develop an axiomatics for Kahn process networks originate in various previous works in 
the field. Kahn's original paper [TU] mentions results of decidability of the equivalence of 
graphs representing networks (which are called schemata) based on earlier works [9J . Many 
subsequent articles underline the importance of operations on networks such as sequential 
composition, parallel composition, tupling (products) and feedback [111 I25| , and a traced 
monoidal category modeling Kahn networks was constructed in [16] . On the categorical side, 
the "drawings" used here have been formalized as string diagrams representing morphisms 
in monoidal categories [17j . Traced monoidal categories were introduced in [18] and turned 
out to be a fundamental tool in computer science [T]. Their axiomatics was simplified and 
studied in the cartesian case [H] and constructions of free traced monoidal categories were 
provided in [2J [T5] . 

1.1 Nets 

A signature £ = (E, a, r) consists of a set £ of symbols and two functions cr, r : £ — > N, 
which to every symbol a associate its arity and coarity respectively - we thus sometimes 
write a : o~(a) —> r(a): the symbols should be thought as possible building blocks for a 
process network, with specified number of inputs and outputs. Given such a signature, a 
net consists of instances of symbols (called operators) whose inputs and outputs are linked 
together through wires (called ports) defined as follows. Given an integer n, we write (n) 
for the set {0, ... ,n — 1}. 

► Definition 1 (Net). A net N = (P, O, A, s, t) from m to n, with m, n £ N, consists of 

- a finite set P of ports, 

- a finite set O of operators, 

- a labeling junction A : O — > £, 

■ a source function s : Sn — > P and an injective target function t : Tjv — > P, where 
S N = {(x,i) \x eO,ie (o-o\(x))}&{n) T N = {(x,i) \ x eO,ie (roA(x))}ttl(m) 

We sometimes write TV : m — > n to indicate that TV is a net from m to n. 

► Example 2. Suppose that E contains two symbols a and (3 whose sources (given by a) are 
both 2 and targets (given by r) are respectively 1 and 2. The net drawn in the introduction of 
this section can be formalized as a net N : 2 — > 2 defined by P — {po, . . . ,Pi}, O = {xq, xi}, 
A(xo) = a, X(xi) — (3, s and t are defined by 

s(x o ,0)=po s{x ,l)=P4 s(xi,0)=p 2 s(x 1 ,l)=p 1 s(0) = p 3 s{l)=pi 
and t(x ,0)=p 2 t(x ll 0)=p z t(xi,l)=p 4 t(0) = p a t(l) = pi 



Graphically, this can be pictured as on the right. The bullets 
on the left and on the right indicate the source and target m 
and n and the dotted lines represent the induced source and 
target functions (m) — > P and (n) — > P respectively. Notice 




that a port can be used as input for multiple wires as it is the case for the port p^ in the 
example. However, t being injective, two wires cannot have the same output port. 

► Definition 3. A morphism ip : M — > N between two nets M, N : m — > n (with the 
same source and target) consists of a pair of functions tpp : Pm — > Pn and tpo ■ Om On 
such that for every operator x € Om, ^Ni^oix)) = \m{x), for every source (x,i) G Sm, 
fp{sM(x,i)) = sts[(}Po(x),i), for every k £ (n), ipp(sN{k)) — sm(^) and similar equations 
for target functions. Two nets M and N are isomorphic when there exists an invertible 
morphism between them, which we write M « N. 
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► Definition 4. In order to define a category whose objects are integers and morphisms are 
nets (considered up to isomorphism), we introduce the following constructions: 

■ Identity. The identity net N : n — >• n is the net such that P = (n), = and 
s,t : (n) — >• P are both the identity function. 

Composition. Given two nets M : ni — > n<i and N : ni —> n%, their composite 
N o M : ni — !> 7J3 is the net defined by P — Pm W Pn I ~ where ~ is the smallest equiva- 
lence relation such that ~ iiv(fe) for every k G (712), O — Om^On, A = AmWAn, s 
is defined by s(x, i) = sm{x, i) if x G Om, s(x, i) = sn(x, i) if x G On and s(k) = sjv(fc) 
if k G (7x3), and t is defined similarly. 

Tensor. Given two nets M : m —¥ to' and N : n — > n', their tensor product net 
M ® iV : m + n m' + n' is the net which is defined by P = P A / W Pw, O = Om W Ojv, 
A = Am W Ajvi s is defined by s(x,i) = sm(i,i') if x € Om and s(x,i) = spj(x,i) if 
a; G Oat, s(k) = su(k) if fc G (to') and s(k) = sw(k — m') if /c G (fi'), and i is defined 
similarly. 

Trace. Given a net N : n\ + n — > ri2 + n, we define the net Tr™ n2 (N) : n\ — > n2 by 
P = Pjv/ ~ where ~ is the smallest equivalence relation such that SN(n2+k) = t^ini+k) 
for every k G (n), O^Ojv, A = Ajy, s ~ qo s^ and t = qotjy where g : Pat — > P is the 
canonical quotient map. 

It can easily be shown that the constructions above are compatible with isomorphisms 
of nets (e.g. if M w M' and N m N' then M®N m M'®N'). It thus makes sense to define 
the following category: 

► Definition 5. We write Nets for the category Nets whose objects are natural integers, 
morphisms N : m — > n are isomorphism classes of nets, identities and composition are given 
by the constructions of Definition 0] 

► Lemma 6. The category Nets is well-defined and is monoidal with the tensor product of 
Definition [7] and as unit. 

► Remark. In order to make a more fine-grained study of the categorical structure of nets, 
we could have avoided quotienting morphisms by isomorphisms of net and defined a bicat- 
egory [S] whose O-cells are integers, 1-cells are nets and 2-cells are morphisms of nets. We 
did not do this here to simplify the presentation. 

► Remark. This construction, as well as the following, can be extended without difficulty 
to define multisorted nets (i.e. where the various inputs of operators have different types), 
see |15j for a similar construction. A nice and abstract description of this construction can 
be carried on using polygraphs [S], in a way similar to ^M\ . 

Even though the output of an operator can be duplicated or erased, the category Nets 
fails to have finite products. This is essentially due to the fact that duplication and erasure 
are not natural, e.g. the following nets (of type 1—^2 and 1 — > respectively) are different: 

<• • 

We can however recover products by considering the two inequalities above as rewriting 

rules on nets from left to right as follows. 

Sharing. Given a net N : m — » n, suppose that there exists two operators x,y G O 
with the same label and the same inputs, i.e. X(x) = A(y) and for every i G (a o A(x)), 
s(x,i) = s(y,i). We define a net N' : m — > n by P = Pjv/ ~ where ~ is the smallest 
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equivalence relation such that t(x, i) ~i(y, i) for every i £ (r o X(x)), O = On/ ~' 
where ~' is the smallest equivalence relation identifying x and y, and A, s and t are 
obtained by quotienting the corresponding functions of N. The net N' is said to be 
obtained from TV by sharing. 

Erasing. Given a net N : m — > n, suppose that there exists an operator x £ O such that 
for every i £ (to X(x)), s^ 1 (t(x, i)) Informally, none of the outputs of the operator x 
is used as an input for some other operator. We write N' : to — >• n for the net obtained 
from N by removing the operator x as well as all the ports t(x, i) for i £ (r o X(x)). The 
net N' is said to be obtained from N by erasing. 

We say that N se-rewrites to N' when N' can be obtained from N by sharing or erasing. 

The se- equivalence is the smallest equivalence relation containing the se-rewriting relation. 

► Proposition 1. The category sNets obtained from Nets by quotienting morphisms by 
se- equivalence has finite products, given on objects by the tensor product o/Nets- 

Proof. The terminal object is and the product of two objects to and n is m + n with 
the projection of to defined as the net N : to + n — s- m such that P = (m + n), = 0, 
s : (to) — > P is the canonical injection and t : (m+n) — > P is the identity (and the projection 
on n is defined similarly). All required axioms are easily verified. < 

It can be shown that the se-rewriting rules form a terminating (they decrease the number of 
operators) and confluent rewriting system. The normal forms are nets which do not contain 
two operators with the same label and input ports, and do not contain operators such that 
none of the outputs are inputs for some other operator. A direct alternative description of 
nets modulo se-equivalence, called shared nets, can thus be defined as follows. 

► Definition 7. A shared net N = (P. O, s, t) from to to n consists of 
- a finite set P of ports, 

a finite set O of operators which are pairs (a, (si)ie(a-(a))) where a £ E is a symbol and 
( s i)ie(a-(a)) is a family of ports called the sources of the operators, 
■ a source function s : (n) — >• P, 

- an injective target function t : Tn — > P, where Tjv = {{x,i) \ x £ 0,i £ (r o X(x))} 1+1 (to), 
such that for every operator x £ O, s _1 (t(Tj;)) ^ where T x = {(x,i) \ i £ (t o X(x))}. 

► Proposition 2. A category whose objects are integers and morphisms are shared nets 
modulo (suitably defined) isomorphism can be defined in a similar way as previously, and 
this category can be shown to be equivalent to sNets through product-preserving functors. 

Proof. The canonical forms of nets wrt se-rewriting are in bijection with shared nets. < 

Next section justifies why the category sNet provides a convincing definition of the networks. 

1.2 Nets as free fixpoint categories 

We now study the structure of the category sNets in order to define a proper denotational 
model this category. Recall that a (strict) monoidal category (C, ®, I) consists of a category C 
together with a bifunctor ® : C x C — > C, called tensor, and an object I, called unit, such that 
the tensor is strictly associative and admits units as neutral elements. A (strict) symmetric 
monoidal category consists of a monoidal category (C,®,I) equipped with a natural family 
ja,b ■ A® B — > B <g> A of isomorphisms satisfying ^b,a 7A,B — idA®s as well as other 
coherence axioms, see [35] for details. Any category C with finite products admits a structure 
of symmetric monoidal category with the cartesian product x as tensor and the terminal 
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object 1 as unit, and this structure can be chosen to be strict in the case of sNets (thus we 
only consider strict monoidal categories in the following for simplicity) . A natural notion of 
"feedback" was formalized in monoidal categories by Joyal, Street and Verity [T5] as follows: 



► Definition 8 (Trace). A trace on a symmetric monoidal category C consists of a natural 
family of functions Tr* B : C(A®X, B®X) C(A, B). Given a morphism 
f : A® X — > B ® X, the morphism Tr AB (f) : A — > B is often drawn as 
on the right. A trace should satisfy the following axioms 



.4 
X 



f 



B 



1. Vanishing: for every f:A®X®Y — Y B ® X • 



TrX B (Tr 



Y 

A®X,B®X 



(/)) 





2. Superposing: 

for every f : A® X ^ B <2> X xnA g : C -+ D, g® Trf B (f) = Tr^ A ^ B (g <g> /) 



c- 

A- 



-D 
B 



C- 

A- 



-D 
B 



3. Yanking: for every object X, Tr x x {lx,x) 

X — k~ ~ ~J\ — X 



id 



x 




X- 



-X 



► Proposition 3. The construction of Definition^ induces a trace on Nets and on sNets- 

The category sNet CT is a traced cartesian category that we call a fixpoint category in the 
following. Interestingly, it is actually characterized by this structure in the sense that it is 
the free fixpoint category containing a E-object. 

► Definition 9 (S-object). Given a signature E, a E-o&jeci in a monoidal category C consists 
of an object A together with a morphism f a : ®°"W>4 — > A for every symbol a £ E, 
called the interpretation of a, where ® n A denotes the tensor product of n copies of the 
object A. A Yj-morphism between two E-objects (A, f a ) and (B,g a ) consists of a mor- 
phism h: A-> B such that for every a £ E, (^^h) o f a = g a o (O^W/i). 

► Theorem 10. The category sNets is the free category containing a "E-object in the sense 
that for every fixpoint category C, the category Mod(E,C) of Ti-objects and Ti-morphisms 
is equivalent to the category Fix(sNets,C) whose objects are fixpoint functors (preserving 
cartesian product and trace) and morphisms are monoidal natural transformations. 

Proof. The category sNets contains a E-object whose underlying object is 1 and the in- 
terpretation of a symbol a with a(a) = m and r(a) = n is the net N : m — > n such 
that P = (m + n), O = {x}, \{x) = a, s(x, i) — i, s{k) = m + k, t(x, i) = m + i, t{k) = k: 



m + l 
X ■ ■ 



-m+n— 1 
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A construction of the free traced symmetric monoidal category containing a S-object was 
provided in [2] and reformulated in [T5] using a variant of the nets defined here, that we call 
traced nets. It is easy to see that we recover traced nets by restricting sNets to the nets such 
that the source function s is a bijective function. We thus have to show that our category 
of nets is the free category over the category of traced nets. Recall that a cocommutative 
comonoid (M, S, e) in a symmetric monoidal category consists of an object M together with 
two morphisms 5 : M — > M ® M (called duplication) and e : M — !> I (called erasure), 
which are such that (6 <8> id/) o 5 = (id/ ® S) o 8, (e ® id/) o S = S = (id/ <E> s) o 5 and 
7m, m o 5 = 5. Now, it has been shown [5] that the category whose objects are integers and 
whose morphisms / : m — > n are functions / : (to) — > (n) is the free monoidal symmetric 
monoidal category containing a commutative monoid, and that the free cartesian category 
over a symmetric monoidal category is obtained by freely adding a natural structure of 
cocommutative comonoids over each object: precisely, this means that each object M is 
equipped with a structure (M,Sm,£m) of cocommutative comonoid and these are natural 
in the sense that for every morphism / : M — > N , Sn o / = (/ ® /) o § M and en ° f = £m- 
From this it can be deduced that going from nets with bijective s to nets with any function 
as s, and quotienting by se-equi valence, amounts to construct the free cartesian category 
over the category of traced nets. Namely, allowing any function equips the object 1 with a 
structure of comonoid with the duplication Si being the net Ng 1 : 1 — >• 2 such that P = {p}, 
= 0, s(k) = p and t(k) = p and the duplication E\ being the net N £l : 1 — > such that 
P = {p}, O = and t(k) = p: 

N Sl = N E1 = ..... 

(and every object can be equipped with a structure of cocommutative comonoid in a similar 
way) . Quotienting by se-equivalence amounts to impose that the structures of cocommuta- 
tive comonoid on the objects are natural. 



1.3 Models of nets 

The properties of fixpoint categories have been studied in details by Hasegawa and Hy- 
land |14| . In particular, they have shown that a cartesian category C is traced if and only if 
it contains a fixpoint operator satisfying suitable axioms (these are sometimes called Conway 
fixpoint operators). For instance, the category of Scott domains recalled below admits such 
a fixpoint and is therefore a fixpoint category thus providing a natural semantics for nets. 

A directed complete partial order (or dcpo) is a poset (D, ^) such that every directed 
subset X has a supremum \J X and a complete partial order (or cpo) is a dcpo with a least 
element _L [HI SI HO]- A function / : A — > B between two dcpo is Scott- continuous when 
it preserves supremums. By the Kleene fixpoint theorem, every Scott-continuous function 
/ : X — !> X admits a least fixpoint fkj(/) defined by fixx(/) = V«eN /"(J-x), where /" 
denotes the composite of n instances of /. Suppose given a function f: AxX^BxX. 
We write ttb ■ B x X — > B and irx ■ B x X —> X for the canonical projections. Given a G A, 
we write f a — x i— >• /(a, x) for the partial application of / to a. A trace can defined on / by 

I^AsC/) = a | -> 7Ts(fix Bx x(/a ° TTx)) (1) 

and this function can be shown to be Scott-continuous. 

► Proposition 4. The category Cpo of cpo and Scott- continuous functions is a fixpoint 
category with (|TJ) as trace. 
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By Theorem ITU1 any E-object in Cpo canonically induces a functor F : Nets — > Cpo 
which associates to every net its domain semantics: once we have interpreted each symbol 
as a Scott-continuous function (by fixing a E-object), the interpretation of each network 
is also fixed. In particular, when the E-object is the domain R°° of i?-valued streams 
(for some set R), we recover the usual Kahn semantics [H] of nets: R°° is the domain 
whose elements are finite or infinite sequences (called streams) of elements of R, ordered by 
inclusion. The intuition here is that time is discrete (because we only consider the times 
where some information is passed on a wire as instants) and the elements of the domain are 
the sequences of values passed on wires at the various instants. 

► Example 11. Consider a signature E containing two symbols + : 2 — > 1 and i : 1 — > 1. We 

consider the E-object R°° in Cpo such that the interpretation of + is the Scott-continuous 
function R°° x R°° — > R°° such that the image of two 
streams of same length is their pointwise addition and 
the interpretation of I is the function R°° — > R°° which 
prepends a to streams. The interpretation of the net 
on the right is the function which returns the stream whose n-th value is the sum of the 
ri + 1 first values of the stream. 

An element of the Kahn domain can be considered as a partial function s : N — >• R 
whose domain of definition is an initial segment of N (the integers in N represent the in- 
stants of the time). Our goal here is to consider a semantics where time is continuous, 
i.e. streams are generalized to partial functions s : R + — > R defined on an initial segment 
of R + and to relate it to the Kahn semantics. In order to build bridge between the two 
models, the intuition here is that continuous time can be considered as "discrete" if we allow 
ourselves to consider infinitesimals: the time in R + can namely be thought as a sequence of 
instants 0, dt, 2 dt, 3 dt, . . . where dt is an infinitesimal, thus enabling us to extend techniques 
developed for Kahn networks to continuous time semantics. Moreover, many operations of 
common use in analysis can be simply formulated by an appropriate net with the continuous 
time semantics. For instance, the derivative of a function whose definition can be formulated 
as fit) = (f(t) — fit — dt))/ dt can be implemented by a net of the form ^ which directly 
translates to nets the above formula. The rest of the paper is devoted to explaining and 
formalizing these ideas by using of non-standard analysis which allows us to rigorously make 
sense of the notion of infinitesimal. 

2 A non-standard semantics for Kahn networks in continuous time 
2.1 Hyperreals 

We give here a brief introduction to non-standard analysis and refer the reader to text- 
books [HI [571 [55] for details. The motivation underlying the construction of hyperreals is 
to extend the field R of real numbers into a field *R in which one can give a meaning to the 
notions of infinitesimal and infinite numbers. Basically, hyperreal numbers are defined as 
countable sequences (xi)i^ of real numbers, the sequences converging towards represent- 
ing infinitesimals. Any real x can be seen as the hyperreal which is the constant sequence 
whose elements are equal to x, moreover the usual operations are extended pointwise to 
hyperreals, e.g. the multiplication is defined by {x^ x (yi) = {xi x yi). In order for suitable 
axioms to be satisfied (for instance every non-null hyperreal should have an inverse) one has 
to consider equivalence classes of such sequences; in particular, any two sequences which only 
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differ on a finite number of values should be equivalent. The starting point of non-standard 
analysis is the fact that a suitable equivalence relation can be defined from an ultrafilter: 

► Definition 12 (Ultrafilter). A filter on a set / is a collection T of sets which is closed 
under intersection and under supersets (i.e. if U C V C I and U G T then V G J 7 ). A 
filter is proper when G" J 7 . An ultrafilter on / is a proper filter such that for every U C J, 
either U e J or I\U G T . An ultrafilter T is principal when there exists i £ I such that 
J r ={t r C/|zG U}, and non-principal otherwise. 

Assuming Zorn's lemma (which is equivalent to the axiom of choice) , it can be shown that 

► Proposition 5. Any infinite set I has a non-principal ultrafilter on it. 

We now fix such an ultrafilter J on N whose elements are called large sets. The fact 
that J- is non-principal implies that it does not contain any finite subset of N: the construc- 
tion of the ultrafilter can thus be thought as a way of constructing a set, starting from all 
cofinite sets, and coherently adding either I or its complement for every set I C N which 
is neither finite nor cofinite. We define an equivalence relation = on countable sequences 
of reals by (xi) = (yi) when {i G N | Xi = y,} G T and denote by (xi) the equivalence class 

of (Xi). 

► Definition 13 (Hyperreals). The set *R of hyperreals is the set of equivalence classes 
(wrt =) of countable sequences of reals. 

The set *N of hyperintegers is defined similarly and there is a canonical inclusion *N C *R. 

Any countable sequence (xi) of reals induces an hyperreal (xi), and in particular a real r 
can be seen as an hyperreal *r = (r) by considering the equivalence class of the constant 
sequence whose elements are equal to r (we sometimes leave this conversion implicit). Sim- 
ilarly, a countable sequence (Xi) of subsets of R induces a set (Xi) of hyperreals defined as 
the set of (xi) G *R such that {i G N | Xi G Xi} e J. A subset of *R is an internal set if it 
can be obtained this way, in particular any set X C R induces an internal set *X — (X), as- 
sociated to the constant sequence (for instance (R) = *R). Similarly, a countable sequence 
of functions (fi : Ai — > Bi), where the Ai and Bi are subsets of R, extends to a func- 
tion (fi) : (Ai) — > (Bi), defined on (x t ) G (Ai) by (fi)((xi)) = (fi{x l )) where fi(x t ) = fi(xi) 
if Xi G Ai and fi(xt) = otherwise. Such a function is called an internal function. Any 
real- valued function / : A — » B may be seen as an internal function */ = (/): (A) — » (B). 
The notion of internal relation is defined similarly. 

► Remark. As we explain in Section f2 . 1 . 1 L it is important to keep in mind that not every 
set IC*I (or function, or relation) is internal. 

Notice that in the above definition of an internal function, we have used as "default value" 
for the functions fi on the elements Xi G" Ai. This could be avoided by choosing a suitable 
representative in the equivalence class (xt): 

► Lemma 14. Given an element x of an internal set (Ai) , there exists a sequence (yi), such 
that yi G Ai for every index i, satisfying (yi) = x. 

In the way described above, all the usual operations on reals extend to hyperreals (and 
similarly for hyperintegers). For instance, the absolute value of an hyperreal x = (xi) is 
defined by |x| = An hyperreal x of *R is infinitesimal whenever |x| < r for every 

real r > 0, and unlimited if r < |x| for every real r G R. Given a hyperreal x which is not 
unlimited, there exists a unique real y such that x — y is infinitesimal: this real is called the 
standard part of x and denoted by st(x). We define an equivalence relation ss on hyperreals 
by x w y whenever st(x — y) = 0. 
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► Remark. The existence of a standard part might be surprising at first: for instance, 
given the sequence Xi such that X{ = if i is even and Xi = 1 otherwise, what should be 
the standard part of (a;,)? The result is given by the chosen ultrafilter T: if the set / of 
even integers is in T then st((xi)) = 0, otherwise the set N \ I of odd integers is in T 
and st((xi)) = 1. 

► Remark. The method used to construct *R is an instance of a very general construction of 
ultraproducts in model theory, which can be used to define a non-standard model *X from 
any model X [2T1 [271 [T2] . In particular, given sets X and Y, this construction applied to 
the set Y x of functions from X to Y constructs the set *(Y X ) of internal functions from *X 
to *Y. 

2.1.1 The transfer principle 

A fundamental tool in non-standard analysis is the transfer principle, which follows from 
Los theorem |21j . Informally, this principle can be formulated as follows 

► Proposition 6 (Transfer principle). A first- order formula ip is satisfied in R if and only if 
it is satisfied in *K, if we assume that all the sets, functions and relations involved in the 
formula are internal. 

A similar theorem can be formulated for *N. Many constructions of standard analysis 
can thus be transferred to non-standard analysis. For instance, the sets *N and *R are, 
respectively, a ring and a field and both are totally ordered. 

► Remark. The assumption that we consider only internal objects is very important. For 
instance the formula ((Va; € A. x e N) A (3x e N. x e A)) => (3x e AVy e A. x < y) is 
true in N: every non-empty subset A of N admits a smallest element. From this, we can 
deduce by transfer that every non-empty internal subset of *N admits a smallest element. 
However, this property does not hold for every subset of *N: for instance, *N \ N does not 
have a smallest element since it can be shown to be closed under predecessor, and is thus 
not internal. Likewise a subset of *N (resp. *R) is internal if and only if it is finite. 

2.1.2 Non-standard analysis 

One of the most interesting property of hyperreals is that it allows one to rigorously consider 
infinitesimals and thus formalize in an elegant way many of the tools in common use in 
standard analysis. We give below some of these reformulations which will be of use afterward. 

► Proposition 7 (Continuity). A function f : R — > R is continuous at x when for ev- 
ery y G *R such thaty « x, we have */(y) ~ f{%)- Otherwise said, f is continuous atx when 
for every infinitesimal S w 0, there exists an infinitesimal s « such that * f(x+8) = f(x)+e. 

► Proposition 8 (Differentiation). A function / : R — > R admits y € R as derivative at x e R 
when for every non-null infinitesimal 8 m 0, we have (* f(x + S) — f(x))/S ~ y. Furthermore, 
if f is continuously differ entiable on R, then for any two non-null distinct infinitesimals S 
and e, and for any x € R, we have 



Given a continuous function / : R — > R, its integral on an interval [a, b] is defined by 
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Notice that each sum makes sense because it is finite since it is indexed over the finite 
set {fc 6 ft | O < «}• This notion of finite set can be generalized to internal 
sets as follows: an internal set A = (Ai) is hyperfinite if almost all the A4 are finite, 
i.e. {i £ N I Ai is finite} £ J- . By an argument similar to Lemma 1141 we can always 
suppose that all the Ai are finite by choosing a suitable sequence of finite sets Bi such 
that (Bi) — (Ai). Given such an internal set and an internal function (/,), we define 



► Proposition 9 (Integration). Given a function f : R — > K which is continuous on an 
interval [a,b], excepting possibly a finite number of points of discontinuity, we have 



where 8 = 1/n for some unlimited n = (rii) £ *N and N is the hyperfinite set N — (Ni) C *R 
with Ni = {ki/ni £ R I ki £ N, $J fcj < Hi}. In particular, the result does not depend on 
the choice of the unlimited hyperinteger n £ *N. 

The notion defined above corresponds to the Riemann integral. More refined notions (such 
as the Lebesgue integral) can also be adapted to the non-standard setting. 

2.2 Internal domains 

In this section, we introduce the notion of internal domain, which we use to define a non- 
standard denotational semantics for process networks. Given a totally ordered set T and a 
set R, we write R^ T for the set of partial functions s : T — > R defined on an initial segment 
of T, called the domain of definition of s. The elements of R^ T are called streams: the 
set T can be thought as time and the elements of R as the possible values of a stream over 
time. Every such set can be equipped with a partial order C such that, given r, s £ R^ T , 
we have /Eg whenever the definition domain of r is included in the definition domain of s 
and r and s coincide on the domain of definition of r. 

► Proposition 10. The poset (R^ T , E) is a cpo with smallest element _L being the function 
nowhere defined. 

► Example 15. The Kahn domain described in Section IT7H1 is i?^ N . 

Every function / : R — > R lifts to a function / : R^ T — > R^ T such that, given s £ R^ T , the 
domain of definition of f(s) is the same as the domain of definition of s and the image of s 
is defined by f(s)(t) = f o s(t). The function / is called the lifting of / to R^ T . It is easy 
to show that every such lifting is Scott-continuous. 

In the following, we will be interested in modeling nets operating in a time which varies 
continuously. We thus introduce the following domain in order to model the data flowing 
through the wires: 

► Definition 16 (Continuous-time domain). The continuous-time domain is the complete 
partial order CT = R^ R . The continuous-time domain of continuous functions CCT is 
the subdomain of CT whose elements are continuous partial functions R + — > R. 

As explained in the introduction, the purpose of this paper is to explain how to implement 
Scott-continuous functions over this domain using Kahn networks by formalizing the follow- 
ing intuition using non-standard semantics: continuous time can be considered as "discrete" 
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where the duration between two instants is infinitesimal. A natural candidate for this would 
be the domain N . Namely, in the view of Proposition [§1 we would like to relate a 
stream s G R^ R+ with the stream s G N defined on t G *N by s(t) = *s(t5), from some 
infinitesimal 5 G *M. It turns out that the fixpoints computed in *R^* N are not satisfactory. 
For instance, consider the net on the right such that the interpretation j — i 



of the operator i is the function i : *R^* N *R^* N such that the CJzzT> ^ ' 
image of a stream r is the stream s defined by s(0) = and for any non-null hyperinteger t, 
s(t) = ?'(t — 1). We expect the interpretation of this net to be the constant function 
equal to 0. However, this is not the case: the semantics s of this net is given by the 
fixpoint s = fix(t) = VfceN L (-^-) °f L - Given k G N, the domain of definition of the 
stream t fc (_L) is the set {p £ *N | < p < k}. Therefore, given an unlimited n G *N, 
i fc (_L)(n) is undefined for every k G N and thus fix(t)(n) is undefined. Intuitively, the 
induction on k G N defining the smallest fixpoint is not powerful enough to reach all elements 
of *N. The cpo N is thus not the appropriate domain, however we explain below that 
internal domains are a more suitable notion, because they support an induction principle 
on *N. 

► Definition 17 (Internal cpo). An internal cpo (D, ^) in a non-standard model consists of 
an internal set D = (Di) and an internal relation sj= (^i) such that for every integer i, 
(Di, ^i) is a cpo. Similarly, an internal Scott- continuous function f : D — > E between two 
internal cpo D = (Di) and E = (Ei) consists of an internal function (/j : Di — > Ei) such 
that all the fi are continuous. We write ICpo for the category of internal cpo and internal 
Scott-continuous functions. 

► Remark. Notice that such an internal cpo (D, ^) is not necessarily a cpo: only internal 
directed subsets are required to have a supremum. For instance suppose fixed an unlimited 
hyperinteger n G *N. The set D = {k G *N | k ^ n} equipped with the usual total order 
is an internal cpo, but not a cpo because the (non-internal) subset N C D is directed and 
does not have a supremum. 

► Proposition 11. Any internal Scott- continuous function f : D — > D, where D is an 
internal cpo, admits a least fixpoint fix(/) which satisfies fix(/) = \/{/ n (_L) | n G *N}. 
Here, if f — (fi) and n = (rij), / n is defined as (/J H ). 

The axioms of fixpoint categories can be formulated in first-order logic. Using the transfer 
principle (Proposition [5]) , it can be shown that the fact that Cpo is a fixpoint category 
implies that 

► Proposition 12. The category ICpo is a fixpoint category. 

In the category ICpo, we will be particularly interested in the following domain: 

► Definition 18 (Infinitesimal-time domain). The infinitesimal-time domain is the internal 
complete partial order IT = *(M^ N ). 

As explained in the remark in the end of Section I2TT1 the elements of IT — *(R^ N ) are 
the internal partial functions from *N to *M. The order C on this domain is such that for 
any r, s G IT, we have r C s whenever the domain of definition of r is included in the 
domain of definition of s and r and s coincide on the domain of definition of r. 

2.3 Comparing continuous time and infinitesimal time 

In this section, we explain how the semantics of nets in IT can "simulate" operations in CT. 
We now suppose fixed an infinitesimal 5 called sampling period. We define a function 
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S : CT — > IT, called sampling, which to every stream s £ CT associates the stream 
S(s) — k i y *s(k<5), and a function T : IT — > CT, called standardization, which to every 
stream s associates T(s) — x i— > st (s([*x/S\)), where [— J : *R — » *N denotes the floor 
function, and is defined on the biggest initial segment of R + for which this definition makes 
sense. These functions enable us to show that CCT (the domain of continuous streams) is a 
retract of IT. We discuss afterward the possible extensions of this result to elements of CT. 

► Proposition 13. The restriction of the composite T o S to CCT is the identity. 

Proof. Suppose given a stream s £ CCT. For any x £ R + , the fact that s is continuous at x 
implies, by Proposition [71 that for every k £ *N such that k<5 « x, we have 5(s)(kJ) ~ s(x). 
From this we deduce that T(S(s))(x) — s(x). A 

► Remark. The function T o S is generally not the identity on CT. For instance, suppose 
that S — 1/n, where n £ *N is unlimited, and consider the stream s £ CT whose value is 
everywhere except at y/2 where s(y/2) — 1. Using the transfer principle, it is easy to show 
that for every k £ *N, we have k/n ^ y/2. From this we can deduce that T o S(s) is the 
constant stream equal to 0. 

In order to make a more convincing case of the interest of the domain IT as a model 
of nets and study further its relationship with CT, we give below some examples of nets 
interpreted in IT which implement common constructions in analysis, and relate them to the 
corresponding constructions in CT through S and T. For concision, we do not detail the easy 
verification that the interpretations of operators are internal Scott-continuous functions. 

As a first simple example, consider the net (J3J). From the characterization of the fixpoint 
of internal Scott-continuous functions given by Proposition 1 1 11 it is easy to check that its 
semantics s in the domain IT is the constant function (defined everywhere) as expected: if 
we write Co : R + —> K for the constant function equal to 0, we have s = S(cq) and cq = T(s). 

2.3.1 Differentiation 

The differentiation is the following net where "e" is interpreted as the function which drops 
the first element of a stream (i.e. e(s)(k) = s(k + 1)), "— " is interpreted as the pointwise 
difference (i.e. (— (s,t))(k) = s(k) — t(k)), and U /S" is interpreted as the pointwise division 
by S (i.e. («/*)(k) = s(k)/S). 



*-["£□-.... (4) 

We write ip : IT — > IT for the semantics of the net. By Proposition [HI we have immediately: 

► Proposition 14. For any continuously differentiable function s : R + — > R in CCT, 
T(<p(S(s)))=s'. 

Proof. Given k £ *N such that st(k<5) £ R+, yj(5(»))f» = §M^±llziisM ~ s '( s t(kc5)). 
The second step is proved by Proposition [HJ Therefore, T(ip(S(s))) = s' . -4 

2.3.2 Integration 

The integration is the following net where "xJ" is the pointwise multiplication of a stream 
by S, "+" is the pointwise addition of streams, and t prepends to a stream (see Section 121?]) . 
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We write tp : IT — > IT for the semantics of the net. By Proposition we have immediately: 

► Proposition 15. For any function s : R+ -4 M in CCT, T(tp(S(s))) = x ^ f* s (t) dt. 

Proof. The semantics tp of the net is computed by a fixpoint as explained in Section [TJ 
defined by tp(S(s))(0) = 5S(s)(0) and tp(S(s))(n + l) = tp(S(s))(n) + SS(s)(n+ 1). Therefore 
we have tp(S(s))(n) — <5 5^^ =0 S*(s)(k). Finally, by Proposition [HI it can be shown that if 
st(xcS) =iel+, then 5£t=o 5(s)(k) « /* s(t) dt and thus T{tp(S(s))){x) = ft s(t) dt. < 

This construction can be generalized in order to describe solvers for ordinary differential 
equations [3 [S] . It should be noticed that the above propositions show that the choice of 
the infinitesimal sampling period S is essentially irrelevant. 

Most of the preceding results can be adapted to the case where the streams considered 
are only piecewise continuous, with a finite number of discontinuities. In particular, for any 
such stream s we have To S(s)=s where = denotes the equality almost everywhere (this 
weakening of equality is necessary because of phenomena such as the one described in the 
remark following Proposition [TBI -. However, the formalization of this is obscured by the fact 
that piecewise continuous functions, with a finite number of discontinuities, do not form a 
cpo because the supremum in CT of a directed set of such functions might have an infinite 
number of points of discontinuity: this is sometimes referred to as the Zeno phenomenon in 
the study of hybrid systems. 

3 Conclusion and future works 

We have defined nets which provide a formal syntax for process networks, studied the cate- 
gorical structure of their models, and constructed the infinitesimal-time model as an internal 
cpo. The fascinating links between denotational semantics of concurrent systems and non- 
standard analysis have started to be explored only recently and many structures are still 
yet to be clarified. As explained above, the study of the infinitesimal-time domain has to 
be refined in order to cope with streams which are not necessarily continuous, and thus to 
properly model full-fledged hybrid systems. In particular, Proposition 1131 fails to be true 
if we replace CCT by CT: we plan to investigate generalizations of this property where S 
and T form an adjunction. We are also investigating possible adaptations of nets in the 
case where we consider a synchronous semantics (in which there is a notion of simultaneity 
of events) . In this setting, the usual delay operator can elegantly be modeled in feedback 
categories [20. (which are traced monoidal categories with the yanking axiom removed) and 
we plan to study nets for those categories. Finally, we envisage many connections with 
other areas of denotational semantics. For instance, the trace semantics of Kahn networks 
is closely related to game semantics [23 and it is thus natural to wonder if non-standard 
analysis can provide insights about a possible definition of a "continuous game semantics" 
in the spirit of the geometric models for concurrent programs |13) . 
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